Goto

Collaborating Authors

 obstacle course


An Open-Source, Reproducible Tensegrity Robot that can Navigate Among Obstacles

Johnson, William R. III, Meng, Patrick, Chen, Nelson, Cimatti, Luca, Vercoutere, Augustin, Aanjaneya, Mridul, Kramer-Bottiglio, Rebecca, Bekris, Kostas E.

arXiv.org Artificial Intelligence

Tensegrity robots, composed of rigid struts and elastic tendons, provide impact resistance, low mass, and adaptability to unstructured terrain. Their compliance and complex, coupled dynamics, however, present modeling and control challenges, hindering path planning and obstacle avoidance. This paper presents a complete, open-source, and reproducible system that enables navigation for a 3-bar tensegrity robot. The system comprises: (i) an inexpensive, open-source hardware design, and (ii) an integrated, open-source software stack for physics-based modeling, system identification, state estimation, path planning, and control. All hardware and software are publicly available at https://sites.google.com/view/tensegrity-navigation/. The proposed system tracks the robot's pose and executes collision-free paths to a specified goal among known obstacle locations. System robustness is demonstrated through experiments involving unmodeled environmental challenges, including a vertical drop, an incline, and granular media, culminating in an outdoor field demonstration. To validate reproducibility, experiments were conducted using robot instances at two different laboratories. This work provides the robotics community with a complete navigation system for a compliant, impact-resistant, and shape-morphing robot. This system is intended to serve as a springboard for advancing the navigation capabilities of other unconventional robotic platforms.


Development of an Intuitive GUI for Non-Expert Teleoperation of Humanoid Robots

Barret, Austin, Lau, Meng Cheng

arXiv.org Artificial Intelligence

The operation of humanoid robotics is an essential field of research with many practical and competitive applications. Many of these systems, however, do not invest heavily in developing a non-expert-centered graphical user interface (GUI) for operation. The focus of this research is to develop a scalable GUI that is tailored to be simple and intuitive so non-expert operators can control the robot through a FIRA-regulated obstacle course. Using common practices from user interface development (UI) and understanding concepts described in human-robot interaction (HRI) and other related concepts, we will develop a new interface with the goal of a non-expert teleoperation system.


Sea turtle hatchlings struggle through a smelly seaweed maze

Popular Science

Breakthroughs, discoveries, and DIY tips sent every weekday. The smelly, brown seaweed can put a damper on a day at the beach at best and hinder baby turtles on their way to the ocean at worst. Only about one in 1,000 sea turtle hatchlings survive to adulthood, and might be added to their already long list of challenges . The new findings detailed in a study published in the explores the role that this brown seaweed plays on vulnerable sea turtle populations. "For sea turtle hatchlings, reaching the ocean is already a race against time - and survival. Now, increasingly large mats of sargassum are adding new challenges to this critical journey," study co-author and Florida Atlantic University biologist Sarah Milton, said in a statement .


VizFlyt: Perception-centric Pedagogical Framework For Autonomous Aerial Robots

Srivastava, Kushagra, Kulkarni, Rutwik, Velmurugan, Manoj, Sanket, Nitin J.

arXiv.org Artificial Intelligence

All the images in this paper are best viewed in color on a computer screen at 200% zoom. Abstract -- Autonomous aerial robots are becoming commonplace in our lives. Hands-on aerial robotics courses are pivotal in training the next-generation workforce to meet the growing market demands. Such an efficient and compelling course depends on a reliable testbed. We utilize pose from an external localization system to hallucinate real-time and photorealistic visual sensors using 3D Gaussian Splatting. This enables stress-free testing of autonomy algorithms on aerial robots without the risk of crashing into obstacles. We achieve over 100Hz of system update rate. Lastly, we build upon our past experiences of offering hands-on aerial robotics courses and propose a new open-source and open-hardware curriculum based on VizFlyt for the future. We test our framework on various course projects in real-world HITL experiments and present the results showing the efficacy of such a system and its large potential use cases. Code, datasets, hardware guides and demo videos are available at https://pear .wpi.edu/research/vizflyt.html


Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimization

Maus, Natalie, Kim, Kyurae, Zeng, Yimeng, Jones, Haydn Thomas, Wan, Fangping, Torres, Marcelo Der Torossian, de la Fuente-Nunez, Cesar, Gardner, Jacob R.

arXiv.org Artificial Intelligence

In multi-objective black-box optimization, the goal is typically to find solutions that optimize a set of T black-box objective functions, $f_1$, ..., $f_T$, simultaneously. Traditional approaches often seek a single Pareto-optimal set that balances trade-offs among all objectives. In this work, we introduce a novel problem setting that departs from this paradigm: finding a smaller set of K solutions, where K < T, that collectively "covers" the T objectives. A set of solutions is defined as "covering" if, for each objective $f_1$, ..., $f_T$, there is at least one good solution. A motivating example for this problem setting occurs in drug design. For example, we may have T pathogens and aim to identify a set of K < T antibiotics such that at least one antibiotic can be used to treat each pathogen. To address this problem, we propose Multi-Objective Coverage Bayesian Optimization (MOCOBO), a principled algorithm designed to efficiently find a covering set. We validate our approach through extensive experiments on challenging high-dimensional tasks, including applications in peptide and molecular design. Experiments demonstrate MOCOBO's ability to find high-performing covering sets of solutions. Additionally, we show that the small sets of K < T solutions found by MOCOBO can match or nearly match the performance of T individually optimized solutions for the same objectives. Our results highlight MOCOBO's potential to tackle complex multi-objective problems in domains where finding at least one high-performing solution for each objective is critical.


Brain implant lets man with paralysis fly a virtual drone by thought

New Scientist

A man with paralysis who had electrodes implanted in his brain can pilot a virtual drone through an obstacle course simply by imagining moving his fingers. His brain signals are interpreted by an AI model and then used to control a simulated drone. Brain-computer interface (BCI) research has made huge strides in recent years, allowing people with paralysis to precisely control a mouse cursor and dictate speech to computers by imagining writing words with a pen. But so far, they haven't yet shown great promise in complex applications with multiple inputs. Now, Matthew Willsey at the University of Michigan and his colleagues have created an algorithm that allows a user to trigger four discrete signals by imagining moving their fingers and thumb.


Eurekaverse: Environment Curriculum Generation via Large Language Models

Liang, William, Wang, Sam, Wang, Hung-Ju, Bastani, Osbert, Jayaraman, Dinesh, Ma, Yecheng Jason

arXiv.org Artificial Intelligence

Recent work has demonstrated that a promising strategy for teaching robots a wide range of complex skills is by training them on a curriculum of progressively more challenging environments. However, developing an effective curriculum of environment distributions currently requires significant expertise, which must be repeated for every new domain. Our key insight is that environments are often naturally represented as code. Thus, we probe whether effective environment curriculum design can be achieved and automated via code generation by large language models (LLM). In this paper, we introduce Eurekaverse, an unsupervised environment design algorithm that uses LLMs to sample progressively more challenging, diverse, and learnable environments for skill training. We validate Eurekaverse's effectiveness in the domain of quadrupedal parkour learning, in which a quadruped robot must traverse through a variety of obstacle courses. The automatic curriculum designed by Eurekaverse enables gradual learning of complex parkour skills in simulation and can successfully transfer to the real-world, outperforming manual training courses designed by humans.


Design and Control of Modular Soft-Rigid Hybrid Manipulators with Self-Contact

Patterson, Zach J., Sologuren, Emily, Della Santina, Cosimo, Rus, Daniela

arXiv.org Artificial Intelligence

Soft robotics focuses on designing robots with highly deformable materials, allowing them to adapt and operate safely and reliably in unstructured and variable environments. While soft robots offer increased compliance over rigid body robots, their payloads are limited, and they consume significant energy when operating against gravity in terrestrial environments. To address the carrying capacity limitation, we introduce a novel class of soft-rigid hybrid robot manipulators (SRH) that incorporates both soft continuum modules and rigid joints in a serial configuration. The SRH manipulators can seamlessly transition between being compliant and delicate to rigid and strong, achieving this through dynamic shape modulation and employing self-contact among rigid components to effectively form solid structures. We discuss the design and fabrication of SRH robots, and present a class of novel control algorithms for SRH systems. We propose a configuration space PD+ shape controller and a Cartesian impedance controller, both of which are provably stable, endowing the soft robot with the necessary low-level capabilities. We validate the controllers on SRH hardware and demonstrate the robot performing several tasks. Our results highlight the potential for the soft-rigid hybrid paradigm to produce robots that are both physically safe and effective at task performance.


Tiny jellyfish robots made of ferrofluid can be controlled with light

New Scientist

Jellyfish-shaped robots made of magnetic ferrofluid can be controlled by light through an underwater obstacle course. Swarms of these soft robots could be useful for delivering chemicals throughout a liquid mixture or moving fluids through a lab-on-a-chip. Ferrofluid droplets are made of magnetic nanoparticles suspended in oil, and they can move across flat surfaces or change shape when coaxed in different directions by magnets. By immersing these droplets in water and exposing them to light, Mengmeng Sun at the Max Planck Institute for Intelligent Systems in Germany and his colleagues have now made them defy gravity. When ferrofluids absorb light – they are particularly good at that because they are dark – they heat up and any tiny bubbles within them expand.


Autonomous Ground Navigation in Highly Constrained Spaces: Lessons learned from The 3rd BARN Challenge at ICRA 2024

Xiao, Xuesu, Xu, Zifan, Datar, Aniket, Warnell, Garrett, Stone, Peter, Damanik, Joshua Julian, Jung, Jaewon, Deresa, Chala Adane, Huy, Than Duc, Jinyu, Chen, Yichen, Chen, Cahyono, Joshua Adrian, Wu, Jingda, Mo, Longfei, Lv, Mingyang, Lan, Bowen, Meng, Qingyang, Tao, Weizhi, Cheng, Li

arXiv.org Artificial Intelligence

The 3rd BARN (Benchmark Autonomous Robot Navigation) Challenge took place at the 2024 IEEE International Conference on Robotics and Automation (ICRA 2024) in Yokohama, Japan and continued to evaluate the performance of state-of-the-art autonomous ground navigation systems in highly constrained environments. Similar to the trend in The 1st and 2nd BARN Challenge at ICRA 2022 and 2023 in Philadelphia (North America) and London (Europe), The 3rd BARN Challenge in Yokohama (Asia) became more regional, i.e., mostly Asian teams participated. The size of the competition has slightly shrunk (six simulation teams, four of which were invited to the physical competition). The competition results, compared to last two years, suggest that the field has adopted new machine learning approaches while at the same time slightly converged to a few common practices. However, the regional nature of the physical participants suggests a challenge to promote wider participation all over the world and provide more resources to travel to the venue. In this article, we discuss the challenge, the approaches used by the three winning teams, and lessons learned to direct future research and competitions.